Display system

ABSTRACT

A display for providing information relating to an object relative to the display is disclosed. The display includes a plurality of pixels, and a plurality of light sensors. An individual light sensor of the plurality of light sensors is provided near an individual pixel of the plurality of pixels. An individual light sensor of the plurality of light sensors is configured to detect light. The information relating to the object relative to the display may be provided by correlating the amount of detected light from the plurality of light sensors to the information relating to the object.

BACKGROUND OF THE INVENTION

[0001] The present invention relates generally to the field of displays.The present invention more specifically relates to the field ofinteractive displays such as touch screens and touch panels.

[0002] It is known to provide for interactive displays such as touchscreens and touch panels for use with devices (such as computers,handheld devices, personal digital assistants (PDAs), informationkiosks, and the like).

[0003] Touch screens allow for interaction (such as user interaction oruser interface) with the device via the display. A user may interfacewith the device or with software via the display, by touching thedisplay in certain areas, inputting text or graphic characters into thedevice, etc. One such interface may be a Graffiti™ writing section, orother hand recognition software, for tracing alpha numeric characters asinput.

[0004] Touch screens typically include three layers: a touch panellayer, a display layer below the touch panel layer, and a backlightlayer below the display layer. The touch panel layer is the layer thatis receptive to motion, touch, position, etc. of objects such as astylus, pen, pointing device, a human's finger, etc. Typical touchpanels may use resistive or capacitive touch panels to provide aninteractive display.

[0005] Resistive touch panels typically consist of a glass or acrylicpanel that is coated with electrically conductive and resistive layers.When operating, an electrical current moves through the touch panel.When pressure is applied to the touch panel, the layers are pressedtogether, causing a change in the resistance and a touch event isdetected.

[0006] A capacitive touch screen consists of a glass panel with acapacitive (charge storing) material coating its surface. Sensorslocated at corners of the screen typically measure the capacitance of anobject touching the coated surface. X and Y coordinates of any touchevent are then determined based on the relative capacitance measurementsmade by the four sensors.

[0007] These touch panel layers are typically constructed from glass oracrylic. The touch panel layer typically may have a thickness ofapproximately 2 millimeters. The inclusion of the touch panel layer tothe device adds to the overall size (such as thickness) of the device,as well as adding to the weight of the device. As devices such as PDAsbecome smaller and lighter, there is a need to reduce both the size andweight of the devices. Accordingly, it would be advantageous to providean interactive display for use with a device, such as a PDA, which wouldnot require a touch panel layer.

[0008] Additionally, the touch panel layer may have a transparency of80-85 percent. That is, light passing through the touch panel will have80-85 percent of its original brightness or intensity. Due to the touchpanel layer, the brightness or intensity of the display layer isdiminished. In order to have a certain level of brightness or intensity,the display layer must have a higher output to overcome the losses inthe touch panel layer. This in turn places a greater burden or drain ona power source (typically batteries).

[0009] Accordingly, it would be desirable to provide an interactivedisplay that would not cause a reduction in the intensity or brightnessof the display layer. It would further be advantageous to provide aninteractive display that would provide for the level of brightness orintensity of present displays, while also requiring less power thantypical displays. It would further be advantageous to provide a display(such as a touch screen) which would provide for user input or interfacevia the display. The techniques below extend to those embodiments whichfall within the scope of the appended claims, regardless of whether theyprovide one or more of the above-mentioned advantageous features.

SUMMARY OF THE INVENTION

[0010] One embodiment of the invention relates to a display forproviding information relating to an object relative to the display. Thedisplay includes a plurality of pixels, and a plurality of lightsensors. An individual light sensor of the plurality of light sensors isprovided near an individual pixel of the plurality of pixels. Anindividual light sensor of the plurality of light sensors is configuredto detect light. The information relating to the object relative to thedisplay may be provided by correlating the amount of detected light fromthe plurality of light sensors to the information relating to theobject.

[0011] Another embodiment of the invention relates to a handheld devicehaving a display for providing information relating to an objectrelative to the display. The handheld device includes, data processingelectronics, and a display coupled to the data processing electronics.The display includes a plurality of pixels, and a plurality of lightsensors. An individual light sensor of the plurality of light sensors isprovided near an individual pixel of the plurality of pixels. Anindividual light sensor of the plurality of light sensors is configuredto detect light. The information relating to the object relative to thedisplay may be provided by correlating the amount of detected light fromthe plurality of light sensors to the information relating to theobject.

[0012] Another embodiment of the present invention relates to a methodof detecting information relating to an object near a screen. The screenhas a plurality of pixels and a plurality of light sensors near thepixels. An individual light sensor is provided near an individual pixel.The method includes receiving data corresponding to levels of light withthe light sensors, and correlating the information relating to theobject near the screen to the sensed level of light of the plurality oflight sensors.

[0013] Another embodiment of the present invention relates to a displayincluding a plurality of pixels, a plurality of light sensors where anindividual light sensor is provided near at least one pixel of theplurality of pixels, a graphics controller coupled to the plurality ofpixels, and a logic unit coupled to the plurality of light sensors.

[0014] It would be desirable to provide a system and/or method thatprovides one or more of these or other advantageous features. Otherfeatures and advantages will be made apparent from the presentspecification. The teachings disclosed extend to those embodiments whichfall within the scope of the appended claims, regardless of whether theyaccomplish one or more of the aforementioned needs.

BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The invention will become more fully understood from thefollowing detailed description, taken in conjunction with theaccompanying drawings, wherein like reference numerals refer to likeelements, in which:

[0016]FIG. 1 is a schematic representation of a display according to anexemplary embodiment;

[0017]FIG. 2 is a partial cross-section view of the display shown inFIG. 1, taken along the line 2-2;

[0018]FIG. 3 is a schematic representation of a display in operation,according to an exemplary embodiment;

[0019]FIG. 4 is a flow chart showing a method for determining a positionof an object relative to a screen, according to an exemplary embodiment;

[0020]FIG. 5 is a schematic representation of a display according to analternative embodiment;

[0021]FIG. 6 is a schematic representation of a pixel according to analternative embodiment; and

[0022]FIG. 7 is a depiction of a handheld device having displayaccording to an exemplary embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

[0023] Referring to the FIGURES, exemplary embodiments of a display(such as an interactive display, touch screen, touch panel, etc.) areshown. The exemplary embodiments of displays provide for userinteraction (such as by touching, pointing, placement of objectsproximate to the display, etc.) for use in conjunction with variousdevices (such as computers, handheld devices, personal digitalassistants (PDAs), portable computing devices, handheld scanners, mobiletelephones, etc.). Exemplary embodiments of a display may employ anarray of one or more light sensors integrated into a display surface, toprovide for interaction, positioning, and tracking of an object (such asa finger, a stylus, a pointing device, a pen, etc.) near the surface ofthe display.

[0024] Shown in FIG. 1 is an exemplary embodiment of a display 10.Display 10 includes a plurality of pixels 20, a plurality of lightsensors 40, a graphics controller 60, and a logic unit 80. As shown inFIG. 2, when light is emitted from a display (either emanating frompixels 20, from a backlight 90, or from other sources), a certain amountof light will pass through a display surface 12, and a certain amount oflight will be reflected or refracted back from display surface 12. Whenan object 70 is near display 10, object 70 reflects or refracts acertain amount of light which has passed through display surface 12,back toward display 10. By detecting the additional amount of light thatis reflected or refracted from object 70, the position of object 70relative to display 10 may be determined, as will be discussed ingreater detail below.

[0025] As shown in FIG. 1, display 10 includes pixels 20 provided fordisplaying information (including text, graphics, images, pictures, andother visual information) on display 10. Pixels 20 may be distributed inan array or grid. Alternatively, pixels may be distributed according toa variety of configurations, orientations, etc. such as a 160×160 pixelmatrix, a 320×320 pixel matrix, any number (such as n×m) pixel matrix, adiamond shaped array pixel matrix, an arrangement where the blue pixelof a color display is shared by four neighboring pixels, etc.

[0026] Each individual pixel 22 of pixels 20 is controlled via graphicscontroller 60. Graphics controller 60 controls various parameters ofpixels 20 (such as the color, intensity, brightness, contrast, on/offstatus, and/or other related control parameters for the pixels), therebyresulting in the display of information on display 10. The combinationof individual pixels 22 results in the pixels 20 displaying informationon display 10. According to one exemplary embodiment, graphicscontroller 60 may be coupled to a central processing unit (CPU) 62. CPU62 may be part of a computing system, computer, handheld device, mobilecomputing device, etc. As shown in FIG. 7, one exemplary embodiment ofdisplay 10 is shown used as a display portion for handheld device 100.

[0027] According to an alternative embodiment (as shown in FIG. 2),display 10 may further include a backlight 90. Backlight 90 may provideillumination of display 10 in low lighting conditions. Backlight 90 mayalso be used to provide a light source which will be reflected by object70, and which light will be detected by light sensors 40.

[0028] As shown in FIG. 1, light sensors 40 (such as photosensors,photo-sensitive elements, a plasma layer excited by a photosensor, etc.)may be distributed in an array or grid pattern. According to oneexemplary embodiment, light sensors 40 are distributed such that anindividual light sensor (shown as individual light sensor 42) is locatednear four individual pixels 22. Alternatively, light sensors 40 may bedistributed in any pattern, configuration, or placement as to allowproper location identification, as will be described below.

[0029] According to an alternative embodiment shown in FIG. 5, a lightsensor 342 may be provided proximate four individual pixels 322. Eachpixel 322 may include three subpixels 322 a, 322 b, and 322 c. In oneexemplary embodiment, subpixels 322 a-322 c allow for the display ofcolor on display 10. Subpixel 322 a may correspond to a red hue,subpixel 322 b may correspond to a green hue, and subpixel 322 c maycorrespond to a blue hue.

[0030] According to an alternative embodiment shown in FIG. 6, lightsensor 442 may be provided in a corner of pixel 422. Alternatively,light sensors may be provided in a variety of different positions andorientations with respect to a pixel or plurality of pixels.

[0031] According to various exemplary embodiments, the light sensor maybe a sensor configured to detect light amount, light intensity,brightness, etc.

[0032] According to one exemplary embodiment, light sensor 42 providesan output (such as an electrical signal) in response to an amount ofdetected light. Light sensor 42 may be tuned to be responsive to certaintypes of light (i.e. infrared, visible, ultra-violet, other types ofelectromagnetic radiation, etc.) as well as specific wavelengths, orranges of wavelengths of light. For example, in one exemplaryembodiment, light sensor 42 is configured to detect light in theinfrared wavelength. This wavelength may be chosen as the wavelength oflight which will be reflected by object 70. For example, if object 70 isa red stylus, light sensor 42 may be configured to detect reflectedlight corresponding to the wavelength of the reflected red color.

[0033] According to one exemplary embodiment, object 70 need not comeinto contact with display surface 12. Rather, object 70 need only benear display surface 12 such that the reflected light from object 70 maybe detected by light sensors 40. Additionally, object 70 may come intocontact with display surface 12 and still cause detection of object 70.

[0034] According to another exemplary embodiment, light sensors 40 maybe configured to detect a change in the index of refraction of pixels20. This change may occur when object 70 is in contact with displaysurface 12. For example, a glass to air transition may cause roughly a 5percent reflection due to the change in the index of refraction.However, a glass to another material (such as a polymer or elastomer)transition may cause a greater that 5 percent reflection due to thechange in the index of refraction. Light sensors 40 may be configured todetect such changes.

[0035] According to another exemplary embodiment, light sensors 40 maybe configured to detect an amount of ambient light present (or absent)due to object 70 from the surrounding environment.

[0036] According to another exemplary embodiment, light sensors 40 maybe configured to detect either or both the reflected light from object70, and detect the change in the index of refraction due to object 70.

[0037] According to one exemplary embodiment, light sensor 42 may be acharge-coupled device (CCD) (or CCD devices), complimentary metal oxidesemiconductor (CMOS) (or CMOS devices), or a variety of other devicesthat provide for light sensing. According to another exemplaryembodiment, pixels 20 and light sensors 40 are integrally formedtogether. For example, CMOS or CCD devices may be manufactured orassembled simultaneously with the pixels of the display.

[0038] As shown in FIG. 1, light sensors 40 are in communication withlogic unit 80. According to various exemplary embodiments, logic unit 80may be a position sensor, an algorithm, hardware, a chip, software, etc.configured to correlate or translate data from light sensors 40 intomore useable information such as position, motion, acceleration, shapeetc. for use by the device. According to one exemplary embodiment, eachlight sensor 42 is coupled to logic unit 80. According to anotherexemplary embodiment, each light sensors 40 may be read as a pluralityof charges, and then the individual readings from light sensor 42 maythe be determined from the single reading of the plurality of charges(e.g. a plurality of light sensors in a CCD device may be read by takingonly one reading) for use by logic unit 80. The signals from lightsensors 40 are passed to logic unit 80, so that logic unit 80 candetermine the position of object 70 relative to display 10. Once theposition of object 70 is determined, the position may then be passed toCPU 62 (or other functional unit such as a memory unit, storage unit,software, operating system (OS), buffer, or other components of thedevice) for use.

[0039] Shown in FIG. 3 is one exemplary embodiment of a method used bylogic unit 80 to determine the location or position of object 70relative to display 10. A schematic representation of a portion ofdisplay 10 is shown with a grid coordinate system; the letters A-Drepresenting columns of display 10, and the numbers 1-4 representingrows of display 10. Each light sensor 42 is labeled for reference with acoordinate point such as A1, C3, B4, D2, A4, etc. For purposes of thisexample, assume that object 70 is placed on or near light sensorcoordinate B2. The presence of object 70 will cause an amount of lightto be reflected off of object 70. Each light sensor 42 will detect anamount of light reflected off of object 70, and each light sensor 42 maydetect a different amount of light than neighboring light sensors. FIG.3A is a schematic representation of the state of each light sensor inthe coordinate system relative to a reference value. The state of eachlight sensor is then passed to a correlation step 82. Correlation step82 may search the light detector data for a maximum or minimum value inorder to determine a position. As shown in FIG. 3A, light detector B2 isshown to have the highest amount of reflected light relative to thereference value. Light detectors A2, B1, B3, and C2 have the nexthighest amount of detected light. Light detectors A1, A3, C1, and C3have the next highest amount of detected light. Light detectors A4, B4,C4, and D1 to D4 have the lowest amount of detected light. Accordingly,because light detector B2 has the highest amount of detected light, theposition coordinate B2 may then be identified as the position of object70 relative to display 10. This information may then be passed to CPU 62(or other functional unit) for use. Alternatively, the positioncoordinate may be correlated to a pixel, a group of pixels, an area onthe screen, etc.

[0040] According to another exemplary embodiment, logic unit 80 may beconfigured to compare the light sensor signals with an expected readoutvalue. For example, when display 10 uses an LCD, and when a graphic isprovided on display 10, certain pixels will be darkened, and otherpixels will remain transparent. The condition of the pixels may causelight detectors 40 to register a shadow due to the graphic, and not dueto the presence of object 70. Logic unit 80 might erroneously detectlighting conditions due to the graphic, and interpret it as informationrelating to object 70. Logic unit 80 may be in communication with theCPU or graphics controller. Logic unit 80 may be provided with anexpected value for the light sensors displaying the graphic, and comparethose values with the actual detected light. Logic unit 80 may subtractoff the effect of the displayed information in order to isolate theeffect of object 70 near the display. A comparison table, calibrationchart, etc. may be used to determine what effect the pixels may have onthe light sensors. Alternatively, the CPU or other processingelectronics may be used to subtract off the effect of the displayedinformation in order to isolate the effect of object 70 near thedisplay.

[0041] According to another exemplary embodiment, a variety ofinformation relating to the object may be detected including position ofthe object, velocity of the object, direction of motion of the object,acceleration of the object, etc.

[0042] According to one exemplary embodiment, the information relatingto the object (i.e. position, direction of motion, velocity, etc.) isprovided to data processing electronics (such as a CPU 62) to determinethe position of object 70 relative to display 10 in response to arequired input (such as requiring a user to point to a specific area onthe display). In another exemplary embodiment, the information relatingto the object is provided to data processing electronics (such as a CPU62) to determine or interpret the motion of object 70 into analpha-numeric text characters (e.g. Graffiti™, etc.) for use with textprocessing programs, user programs, operating systems, etc.

[0043] Referring to FIG. 4, an exemplary embodiment of a method 200 ofproviding interaction of an object and a display is shown. Method 200includes sensing light at a plurality of locations (step 205). Sensinglight at a plurality of locations (step 205) may be done with an arrayof light sensors, with a charge-coupled device (CCD) (or CCD devices),from a complimentary metal-oxide semiconductor (CMOS) image sensor (orCMOS sensing devices), a combination of these devices, and/or a varietyof other devices that provide for light sensing. According to oneexemplary embodiment, the sensed light is an amount of light. Accordingto a second exemplary embodiment, the sensed light is light intensity.Alternatively, the sensed light may be lumens, etc. The light which hasbeen sensed at the plurality of locations is then correlated to providedata relating to the object (step 210). According to one exemplaryembodiment, the data relating to the object is correlated to the lightwhich has been sensed by identifying coordinate positions of the lightsensors which have sensed a maximum amount of light. The coordinateposition data of the object is then provided to a CPU, memory module,computer hardware, or computer software for use (step 215).

[0044] Referring to FIG. 7, a handheld device 100 is depicted, accordingto one exemplary embodiment. Handheld device 100 may include Palm™ stylecomputers manufactured by Palm, Inc., of Santa Clara, Calif. Otherexemplary embodiments of the invention may include Windows CE™ orPocketPC™ handheld computers or other handheld computers or personaldigital assistants, as well as cellular telephones, and other mobilecomputing devices.

[0045] Handheld device 100 may include interactive hardware and softwarethat performs functions such as maintaining calendars, phone lists, tasklists, notepads, calculation applications, spreadsheets, games, andother applications capable of running on a computing device. Handhelddevice 100, depicted in FIG. 7 includes a plurality of input functions,keys 119 and a display 113 having graphical user interface featuresaccording to the present invention. Display 113 may be provided with aninterface that allows a user to select an altered display content usinga pointer, such as, but not limited to, a stylus. In an exemplaryembodiment, display 113 also includes a Graffiti™ writing section 118,or other hand recognition software, for tracing alpha numeric charactersas input. A plurality of input buttons 120 for performing automated orpreprogrammed functions may be provided on a portion of display 113. Ina particular embodiment, display 113 is a touch screen display that iselectronically responsive to movements of a stylus (or other pointingdevice, such as but not limited to a fingertip or pen tip) on or nearthe surface of display 113. Display 113 may include a liquid crystaldisplay (LCD), a thin film transistor (TFT) display, a micro-machinemirror display, and other back lit, side lit, refractive or reflectivedisplays which incorporate the integrated light sensors in pixelcircuitry for digitizer functionality as disclosed in the presentapplication.

[0046] According to various exemplary embodiments, logic unit 80 may beconfigured to distinguish size of shadows detected by light sensors 40.For example, logic unit 80 may be configured to distinguish a largershadow as compared to a smaller shadow. As an example, the larger shadowmay correspond to a hand resting on the display, and the smaller shadowmay correspond to the object 70 near the display. Alternatively, theprocessing electronics, OS, etc. may distinguish shadow sizes.

[0047] According to one exemplary embodiment, the screen may need to beprovided with a higher amount backlight in order to detect higher levelsof detail. For example, if display 10 uses a liquid crystal display(LCD), and the LCD is substantially darkened, additional light may needto be provided in order to be reflected, and thereby detected. The panelmay be designed to allow light (including non-visible light) through thepanel for detection. Alternatively, the panel may be provided with lightguides to allow the light to pass through the darkened display layer.The light which passes through the darkened display layer may then bereflected by object 70, and then detected. An example of light guideswhich may be used in association with display 10 is disclosed in U.S.application Ser. No. 09/997,532, filed Nov. 29, 2001, titled “LightGuide Spacers for Backlighting a Reflective Display,” the entiredisclosure of which is hereby incorporated by reference.

[0048] According to another exemplary embodiment, a filter may beprovide on the sensor to tune the sensor to a particular wavelength. Forexample, the filter may be a plastic or polymer which allows one or morewavelengths to pass. The filter may be provided in a variety oflocations, including on the top of the sensor. Alternatively, the sensormay be tuned to specified wavelengths using other tuning mechanisms.

[0049] It is also important to note that the construction andarrangement of the elements of the display system shown in the exemplaryembodiments are illustrative only. Although only a few embodiments ofthe present inventions have been described in detail in this disclosure,those skilled in the art who review this disclosure will readilyappreciate that many modifications are possible (e.g., variations insizes, dimensions, structures, shapes and proportions of the variouselements, values of parameters, mounting arrangements, use of materials,orientations, colors, etc.) without materially departing from the novelteachings and advantages of the subject matter recited in the claims.For example, the level of sensitivity of the light sensors may beadjusted to eliminate unwanted registrations from dust, smudges, etc. onthe screen, while still registering object information. Accordingly, allsuch modifications are intended to be included within the scope of thepresent invention as defined in the appended claims. The order orsequence of any process or method steps may be varied or re-sequencedaccording to alternative embodiments. In the claims, anymeans-plus-function clause is intended to cover the structures describedherein as performing the recited function and not only structuralequivalents but also equivalent structures. Other substitutions,modifications, changes and omissions may be made in the design,operating conditions and arrangement of the exemplary embodimentswithout departing from the scope of the present inventions as expressedin the appended claims.

What is claimed is:
 1. A display for providing information relating toan object relative to the display, the display comprising: a pluralityof pixels; and a plurality of light sensors, wherein an individual lightsensor of the plurality of light sensors is provided near an individualpixel of the plurality of pixels, and wherein an individual light sensorof the plurality of light sensors is configured to detect light; whereinthe information relating to the object relative to the display may beprovided by correlating the amount of detected light from the pluralityof light sensors to the information relating to the object.
 2. Thedisplay of claim 17 wherein the information relating to the object is aposition of the object.
 3. The display of claim 1, wherein theinformation relating to the object is a motion of the object.
 4. Thedisplay of claim 3, wherein the motion of the object is a direction ofthe motion of the object.
 5. The display of claim 3, wherein the motionof the object is a speed of the motion of the object.
 6. The display ofclaim 1, wherein the information relating to the object is anacceleration of the object.
 7. The display of claim 1, wherein anindividual light sensor of the plurality of light sensors is configuredto detect light intensity.
 8. The display of claim 1, wherein anindividual light sensor of the plurality of light sensors is configuredto detect an amount of light.
 9. The display of claim 8, wherein theamount of light detected by an individual light sensor is an amount oflight relative to the plurality of light sensors.
 10. The display ofclaim 8, wherein the amount of light is an amount of reflected light.11. The display of claim 10, wherein the reflected light is lightreflected off of the object.
 12. The display of claim 1, wherein theplurality of pixels are configured to emit light.
 13. The display ofclaim 12, wherein the plurality of light sensors are configured todetect a portion of light emitted from the plurality of pixels, andwhich portion of light is reflected off of the object.
 14. The displayof claim 1, further comprising a backlight provided below the pluralityof pixels and the plurality of light sensors.
 15. The display of claim1, wherein one light sensor is provided near at least one pixel.
 16. Thedisplay of claim 1, wherein one light sensor is provided near fourpixels.
 17. The display of claim 1, wherein an individual pixel of theplurality of pixels further comprises at least three sub-pixels.
 18. Thedisplay of claim 1, wherein the display is a color display.
 19. Thedisplay of claim 1, wherein correlating the amount of detected lightfrom the plurality of light sensors to the information relating to theobject further comprises: identifying an individual light sensor havinga maximum amount of reflected light; and correlating the location of theindividual light sensor to the information relating to the object. 20.The display of claim 19, wherein the information relating to the objectis a position of the object.
 21. The display of claim 19, wherein theinformation relating to the object is a motion of the object.
 22. Thedisplay of claim 21, wherein the motion of the object is a direction ofthe motion of the object.
 23. The display of claim 21, wherein themotion of the object is a speed of the motion of the object.
 24. Ahandheld device having a display for providing information relating toan object relative to the display, the handheld device comprising: dataprocessing electronics; and a display coupled to the data processingelectronics, wherein the display further comprises: a plurality ofpixels; and a plurality of light sensors, wherein an individual lightsensor of the plurality of light sensors is provided near an individualpixel of the plurality of pixels, and wherein an individual light sensorof the plurality of light sensors is configured to detect light; whereinthe information relating to the object relative to the display may beprovided by correlating the amount of detected light from the pluralityof light sensors to the information relating to the object.
 25. Thehandheld device of claim 24, wherein the object is at least one of astylus, pen, pointing device, and finger.
 26. The handheld device ofclaim 24, wherein the information relating to the object is a positionof the object.
 27. The handheld device of claim 24, wherein theinformation relating to the object is a motion of the object.
 28. Thehandheld device of claim 24, wherein the information relating to theobject is an acceleration of the object.
 29. The handheld device ofclaim 24, wherein an individual light sensor of the plurality of lightsensors is configured to detect light intensity.
 30. The handheld deviceof claim 24, wherein an individual light sensor of the plurality oflight sensors is configured to detect an amount of light.
 31. Thehandheld device of claim 24, further comprising a backlight providedbelow the plurality of pixels and the plurality of light sensors. 32.The handheld device of claim 24, wherein the display is a color display.33. A method of detecting information relating to an object near ascreen, the screen having a plurality of pixels and a plurality of lightsensors, the method comprising: receiving data corresponding to levelsof light from the plurality of light sensors, wherein an individuallight sensor is provided near an individual pixel; and correlating theinformation relating to the object near the screen to the received data.34. The method of claim 33, wherein the information relating to theobject is at least one of position information, velocity information,motion information, and acceleration information.
 35. The method ofclaim 33, wherein receiving data corresponding to levels of lightfurther comprises receiving data corresponding to light intensity. 36.The method of claim 33, wherein receiving data corresponding to levelsof light further comprises receiving data corresponding to light amount.37. The method of claim 33, wherein correlating the information relatingto the object near the screen to the received data further comprisesproviding a coordinate position of the object relative to the screen.38. The method of claim 33, wherein correlating the information relatingto the object near the screen to the received data further comprisesremoving the lighting effects of the pixels from the light sensors. 39.The method of claim 38, wherein removing the lighting effects of thepixels from the light sensors further comprises using a comparison tableof known lighting effects caused by the pixels.
 40. A displaycomprising: a plurality of pixels; a plurality of light sensors, whereinan individual light sensor is provided near at least one pixel of theplurality of pixels; a graphics controller coupled to the plurality ofpixels; and a logic unit coupled to the plurality of light sensors. 41.The display of claim 40, wherein the logic unit is configured to provideinformation relating to the object.
 42. The display of claim 41, whereininformation relating to the object is a position of the object.
 43. Thedisplay of claim 41, wherein the information relating to the object is amotion of the object.
 44. The display of claim 41, wherein theinformation relating to the object is an acceleration of the object. 45.The display of claim 40, wherein an individual light sensor of theplurality of light sensors is configured to detect light intensity. 46.The display of claim 40, wherein an individual light sensor of theplurality of light sensors is configured to detect an amount of light.47. The display of claim 40, further comprising a backlight providedbelow the plurality of pixels and the plurality of light sensors. 48.The display of claim 40, wherein the display is a color display.
 49. Thedisplay of claim 40, wherein the logic unit is part of the graphicscontroller.